Chinese text segmentation for text retrieval: Achievements and problems

1993 ◽  
Vol 44 (9) ◽  
pp. 532-542 ◽  
Author(s):  
Zimin Wu ◽  
Gwyneth Tseng
Keyword(s):  
Chinese Text ◽  
Text Retrieval ◽  
Text Segmentation

scholarly journals Applying the Bell’s Test to Chinese Texts

Entropy ◽  
2020 ◽  
Vol 22 (3) ◽  
pp. 275
Author(s):  
Igor A. Bessmertny ◽  
Xiaoxi Huang ◽  
Aleksei V. Platonov ◽  
Chuqiao Yu ◽  
Julia A. Koroleva
Keyword(s):  
Quantum Entanglement ◽  
Chinese Text ◽  
Search Engines ◽  
Text Processing ◽  
Word Segmentation ◽  
Significant Problem ◽  
Text Segmentation ◽  
Text Documents ◽  
Segmentation Algorithms ◽  
Chinese Texts

Search engines are able to find documents containing patterns from a query. This approach can be used for alphabetic languages such as English. However, Chinese is highly dependent on context. The significant problem of Chinese text processing is the missing blanks between words, so it is necessary to segment the text to words before any other action. Algorithms for Chinese text segmentation should consider context; that is, the word segmentation process depends on other ideograms. As the existing segmentation algorithms are imperfect, we have considered an approach to build the context from all possible n-grams surrounding the query words. This paper proposes a quantum-inspired approach to rank Chinese text documents by their relevancy to the query. Particularly, this approach uses Bell’s test, which measures the quantum entanglement of two words within the context. The contexts of words are built using the hyperspace analogue to language (HAL) algorithm. Experiments fulfilled in three domains demonstrated that the proposed approach provides acceptable results.

scholarly journals A Contrastive Study of Chinese Text Segmentation Tools in Marketing Notification Texts

2019 ◽  
Vol 1302 ◽  
pp. 022010
Author(s):  
Xianwei Zhang ◽  
Peng Wu ◽  
Jiuming Cai ◽  
Kun Wang
Keyword(s):  
Chinese Text ◽  
Text Segmentation ◽  
Contrastive Study

Chinese text retrieval without using a dictionary

1997 ◽  
Vol 31 (SI) ◽  
pp. 42-49 ◽  
Author(s):  
Aitao Chen ◽  
Jianzhang He ◽  
Liangjie Xu ◽  
Fredric C. Gey ◽  
Jason Meggs
Keyword(s):  
Chinese Text ◽  
Text Retrieval

Cross-Language Chinese Text Retrieval in NTCIR Workshop

2001 ◽  
Vol 35 (2) ◽  
pp. 12-19 ◽  
Author(s):  
Kuang-hua Chen ◽  
Hsin-Hsi Chen
Keyword(s):  
Chinese Text ◽  
Text Retrieval ◽  
Cross Language
Sign in / Sign up

Export Citation Format

Share Document